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THE SIMPLIFIED VERSION OF THE SPIELMAN AND 

SRIVASTAVA ALGORITHM FOR PROVING THE 
BOURGAIN-TZAFRIRI RESTRICTED INVERTIBLITY 

THEOREM 

PETER G. CASAZZA 



Abstract. By giving up the best constants, we will see that the original 
argument of Spielman and Srivastava for proving the Bourgain-Tzafriri Re- 
stricted Invcrtibility Theorem [5] still works - and is much simplier than the 
final version. We do not intend on publishing this since it is their argument 
with just a trivial modification, but we want to make it available to the 
mathematics community since several people have requested it already. 

1. Introduction 

Recently, Spielman and Sristave [2] made a stunning achievement by show- 
ing that one of the deeper and most useful results in pure mathematics, the 
Bourgain-Tzafriri Restricted Invertibility Theorem [I], can be proved directly 
with an algorithm. The original proof had a technical error which they cor- 
rected in a later version. But this correction doubled the degree of difficulty of 
the proof. We will see that their original proof is still valid if we are willing to 
give up the best constant in the theorem. 

2. The Theorem and Their Original Proof Adjusted 

Theorem 2.1 (Spielman and Srivastave). Let HI be a Hilbert space with or- 
thonormal basis {t>j}™ =1 . Assume L : EI — > H is a linear operator with \\Lvi\\ = 
1 for all i = 1, 2, ■ • • , n and assume 



T 



i=l 



has m non-zero eigenvalues, all of which are greater than b, and b' = b — 5 > 5. 
If 

Tr[L T (A - biy l L] < -n - 

o 

then there exists a vector oo G {Lwj}™ =1 satisfying: 
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1. cu T (A — b'l)" 1 ^ < — 1, and hence u = Lvj for some m < j < n. 

2. Tr[L T (A + uu T - b'I)' l L] < Tr[L T {A - bl^L] < -n - 

(Note that we added a 2 to the original constant in j2] (part (2) above) 
and as a result we have to change their starting point barrier from (1 — e) to 
(1 - It).) 

Proof. Step I: We show: 

(A - bl)~ l -(A- b'l)- 1 > -{A - b'I)-\ 

Note: In the original paper the above inequality was stated to hold for 8 
instead of 8/2. But this isn't true and is not even true for real numbers. 
Our fix will change their perfect constant for the lower Riesz bound from their 
(l-e) 2 to (l-2e)(l-e). 

Proof: Note first that 8 < V implies 2b' >b' + 8. Thus 

1 1 

> 



and finally 

Now, 

Also, 
and so 
Hence, 

= and thus 



V + 8 ~ 2b' 



1 1 

> 



b'{b' + 8) ~ 2{b') 2 ' 

-1 -1 _b-b' _ 8 ^8 

1 ¥ ~ bb' ~ b'{b' + 8) ~ 2{b') 2 ' ^ 

A; - b < \ - b', 



1 1 

> 



(\-b)(\i-V) ~ (K-b'f 
1 1 b-b' 



A» — fa Xi - V (A i -6)(A i -6') 

8 



> 
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Step 2: We observe that 

Tr[L T {A - b'I)- l L] < Tr[L T (A - 6J) _1 L]. 

Proof: By Step I, we have 

Tr[L T (A-bI)- l L- L T (A-b'I)- l L] = Tr[L T ((A - biy 1 - (A - b'I)' l )L] 

> 5 -Tr[L T (A - b'I)- 2 L] > 0. 

Step 3: We show 

Tr[L T (A - b'iy l LL T (A - b'iy x L\ 
< (Tr[L T (A - &I) _1 L] - Tr[L T (A - b'iy l L})(-n - Tr[L T (A - b'iy l L}). 



Proof: Since 
we have 
and hence, 



Tr[L T {A-b'iy l L]<-n- 2 -^, 



2 < 5 -{-n-Tr[L T {A-b'iy l L)}), 



\\L\\ 2 Tr[L T (A - b'iy 2 L] < 6 -Tr[L T {A - b'I)- 2 L](-n - Tr[L T (A - b'l^L]). 

Applying the proof of Step I, and the facts: (A - b'iy l LL T {A - b'ly 1 > 
and LL T < \\L\\ 2 I, we have 

Tr^iA-b'iy^^iA-b'iy^) (2) 

< \\L\\ 2 Tr[L T (A-b'iy 2 L] 

< 5 -Tr[L T (A - b'iy 2 L](-n - Tr[L T (A - b'^L]) 

< (TV [L T (A - biy^} - Tr[L T (A - b'iy l L)(-n - Tr[L T (A - b'iy l L\). 

Step 4: We pick a vector u satisfying (1) and 

- b'iy l LL T (A - ( 
1 + u(A - b'l)- 1 ^ 



Proof: Noting that u T u = 1, it follows from inequality [2] that there is a vector 
oj G {Lvi}f =1 so that 

^(A-b'iy^^iA-b'iy 1 ^ (3) 

< (Tr[L T (A - bI)- x L] - Tr[L T (A - 67)" 1 L)](-1 - co T (A - b'ly 1 ^) 
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Since the left-hand side of Equation |3] is non-negative, applying Step 1 we have 

< -l-uj T {A-b'iy l u, 

and hence 

lj t (A - b'l)- 1 ^ < -1. 
For 1 < j < m, if a; = Z/Uj, then 



So uj = Lvj for m < j < n. Now, Equation [3] implies 
and the result follows. 

Step; 5: We check part (2) of the theorem. 

Proof: We apply the Sherman-Morrison formula - which states, for a matrix 
A, 



(A + u)uj t )~ 1 = A' 1 



It follows that (Replacing A by A — b'l) 

l t {a + ^ l t (a - m ->L- LT( ^-f ) ;;r r 't 1 wrlL 

1 + ur [A — b'l) 1 u 

Thus, 

Tr[L T (A + uu T -b'ly'L] = 

1 + oj 1 [A — b'l) l uj 
Using the fact that Tr[A5] = Tr[BA], we have that the above equals 

Tr\L T (A b'ir^L\ Tr[^{A-b'I)-^{A-yi)-M _ 
lr[L(A-bl) L\ i + u t {A _ VI) -i u " 

Tr\L T (A - b'l^L] - - T (A-b'irLL-(A-b'I)-^ 
Ir[L [A U) M l + ^(A-b'I)-^ 

We now have applying Step 4: 

< Tr[L T {A - &I) -1 L] 
This completes the proof of the theorem. □ 
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Corollary 2.2 (Bourgain-Tzafriri Restricted Invertibility Theorem). // we 

iterate the algorithm k times, we get k vectors from {Lvi} r ^ =1 with lower Riesz 
bound for the operator A 



1 - 2e - (k - 1)6 = (1 - 2e)(l - (k - 1)^-) 



en 



Hence, 
1- U 



then 



e 2 n 



26) 



\L\ 



e??. 



which is BT. 
2. If 



then 



(1-26) 



(k-1) 



\L\ 



en 



> (1 
= (1 

r— i 
ii^ii 2 

= (i 



26) 

2e)(] 



e 2 n 



L 



en 



and the process stops. 
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